Papers with classification accuracy
Copied to clipboard
| Challenge: | a paper examines the degree to which dialect classifiers remain stable over time . it finds that the models remain robust over time with a fixed decay rate . |
| Approach: | They construct a test set for 12 dialects of English that spans three years at monthly intervals with a fixed spatial distribution across 1,120 cities. |
| Outcome: | The proposed model can reveal linguistic variation over space and time. |
Copied to clipboard
| Challenge: | Evaluating translation models is a trade-off between effort and detail. |
| Approach: | They propose to use a neural text classifier to automatically expose systematic differences between human and machine translations to human experts. |
| Outcome: | The proposed method exposes systematic differences between human and machine translations to human experts. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are inadequate for extracting structured insights from unstructured documents. |
| Approach: | They propose a framework enabling agentic AI for end-to-end document intelligence with four key components: DocSplit, configurable Extraction Module, and Rule Validation Module. |
| Outcome: | The proposed framework achieves 98% classification accuracy, 80% reduced processing latency, and 77% lower operational costs over legacy baselines. |
Copied to clipboard
| Challenge: | small-text is an easy-to-use active learning library for text classification . it features a variety of pre-implemented state-of-the-art query strategies and stopping criteria . |
| Approach: | They introduce small-text, an easy-to-use active learning library for Python . it offers pool-based active learning for single- and multi-label text classification . they find it matches vanilla transformer fine-tuning in terms of classification accuracy . |
| Outcome: | The proposed library outperforms vanilla transformer fine-tuning in classification accuracy and area under the curve. |
Copied to clipboard
| Challenge: | Neural models at the sentence level often need to model the interaction between words . however, there is no guarantee that the standard ordering of words is computationally efficient or optimal . |
| Approach: | They propose to use a dependency parse as a proxy for inter-word dependencies in a sentence to simplify the sentence with combinatorial objectives imposed on the sentence-parse pair. |
| Outcome: | The proposed model improves classification accuracy and reduces classification error by 2.0% over the previous state of the art. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have undergone considerable development and can solve various natural language processing tasks. |
| Approach: | They aimed to achieve both attractiveness and factuality in a dialogue response by crowdsourcing a dataset and performing classification tasks on several models. |
| Outcome: | The proposed model with the highest classification accuracy could yield about 88% accurate classification results. |
Copied to clipboard
| Challenge: | Existing studies on user interest in dialogue systems depend on explicit user feedback. |
| Approach: | They propose a model to implicitly estimate user interest during argumentative dialogues based on semantically clustered data. |
| Outcome: | The proposed model achieves a classification accuracy of 74.9% and tested with different Artificial Neural Networks (ANN) which new argument would fit the user interest best. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated great potential in complex tasks such as multi-label classification, but the vast number of labels can exceed LLMs’ input limits. |
| Approach: | They propose a method that integrates large language models with dense retrieval techniques to overcome these challenges. |
| Outcome: | The proposed methods avoid frequent retraining by leveraging zero-shot and few-shot learning for real-time label assignment. |
Copied to clipboard
| Challenge: | Standard text analytics algorithms are degraded on consumer generated data, a study finds . enterprise data contains domain terms that are not available in general purpose thesaurus . |
| Approach: | They propose unsupervised methods for cleaning noisy repositories after domain terms are segregated from true noise terms. |
| Outcome: | The proposed method improves classification accuracy after noise correction . it is based on a systematic analysis of enterprise data . |
Copied to clipboard
| Challenge: | Text classification is a fundamental problem in natural language processing, but its performance relies on high-quality annotations. |
| Approach: | They propose to use model-agnostic methods to handle inherent noise in large scale text classification that can be easily incorporated into existing machine learning workflows with minimal interruption. |
| Outcome: | The proposed method outperforms baselines by up to 10% in classification accuracy while requiring no network modifications. |
Copied to clipboard
| Challenge: | Discourse learning is a complex task, and schemas evolve across annotation efforts preventing compilation of smaller datasets into larger ones. |
| Approach: | They propose a multitask learning approach that can combine discourse datasets from similar and diverse domains to improve discourse classification. |
| Outcome: | The proposed approach improves on the NewsDiscourse dataset by 4.9% over current state-of-the-art benchmarks on one of the largest discourse datasets. |
Copied to clipboard
| Challenge: | Existing methods to improve the accuracy of large language models (LLMs) are often impractical due to high costs and time consumption. |
| Approach: | They propose a method that uses keyword extraction to reduce prompt tokens in text annotation tasks. |
| Outcome: | The proposed method reduces prompt tokens while maintaining high accuracy. |
Copied to clipboard
| Challenge: | Dialogue Act tagging with ISO 24617-2 standard is a difficult task that requires multiple labels covering semantic, syntactic and pragmatic aspects of dialogue. |
| Approach: | They propose a neural architecture to increase Dialogue Act tagging accuracy by using low-frequency fine-grained tags. |
| Outcome: | The proposed model achieves state-of-the-art tagging results on DialogBank data set . it uses syntactic information in the form of Part-Of-Speech and dependency tags . |
Copied to clipboard
| Challenge: | Existing studies on implicit discourse relation classification have shown success using feedforward networks and convolutional neural networks. |
| Approach: | They propose to augment input text with external knowledge and context and adopt a neural network model that can effectively handle the augmented text. |
| Outcome: | The proposed model outperforms existing models on implicit discourse relation classification. |
Copied to clipboard
| Challenge: | Recent studies have focused on enhancing existing models with the primary objective of improving downstream performance on various NLP tasks. |
| Approach: | They propose to use BERT to encode meaningful knowledge in token representations to explain probing results. |
| Outcome: | The proposed model can detect syntactic and semantic abnormalities and distinguish between grammatical number and tense subspaces. |
Copied to clipboard
| Challenge: | a lack of large-scale annotated datasets hinders effective training of ML models . despite advances in semantic segmentation, challenges persist in distinguishing between closely related roles . |
| Approach: | They propose a large annotated dataset for semantic segmentation of legal documents . they use a rhetorical role classification model to compare performance against other models . |
| Outcome: | The largest annotated dataset for this task outperforms models relying on sentence-level features. |
Copied to clipboard
| Challenge: | Existing validation studies assess output-level agreement; none test causal structure of LLM decisions mirrors that of human decisions. |
| Approach: | They compare topic sentiment and ideology labels using human annotators . they say this is evidence of shortcut learning by fine-tuning on ideology-labeled data . |
| Outcome: | The proposed model internalises a spurious sentiment–ideology coupling not operative in human judgment for this task. |
Copied to clipboard
| Challenge: | Current manual approaches to analyzing overlapping or conflicting content are time-consuming, costly, and error-prone. |
| Approach: | They propose a large language model that uses a construction domain-adapted large language for the semantic comparison of sentences in construction standards. |
| Outcome: | The proposed framework achieves 97.9% accuracy and 0.907 macro F1-score in classifying sentences from Korean construction standards as overlapping, conflicting, or neutral. |
Copied to clipboard
| Challenge: | linguistically motivated features are used to classify paragraph-level text into fiction and non-fiction genres. |
| Approach: | They deploy linguistically motivated features to classify paragraph-level text into fiction and non-fiction genres using a logistic regression model. |
| Outcome: | The proposed model gives 15.56% accuracy jump over baseline model . the proposed model also transfers over to another dataset, Baby BNC corpus . |
Copied to clipboard
| Challenge: | Political stance detection is an increasingly relevant part of analyzing the flow of ideas in online environments where discourse is informal and implicitly expressed. |
| Approach: | They evaluate large language models for political stance detection in informal online discourse by analyzing user profiles derived from historical posts. |
| Outcome: | The proposed model improves accuracy by up to 74% on a political forum dataset. |
Copied to clipboard
| Challenge: | Labeled Anchors is an interactive and supervised topic model based on the anchor words algorithm . |
| Approach: | They propose an interactive supervised topic model based on the anchor words algorithm . they propose a classifier which requires no training beyond topic inference . |
| Outcome: | The proposed model is human-interpretable and fast, and can be interactive. |
Copied to clipboard
| Challenge: | Fine-grained image classification is a challenge for vision-language models (VLMs) such as CLIP, which struggle to distinguish between semantically similar classes due to insufficient supervision for fine-grain tasks. |
| Approach: | They propose a framework that harnesses the complementary strengths of both CLIP-like and LVLMs to tackle these challenges. |
| Outcome: | The proposed framework outperforms existing models on multiple fine-grained datasets, particularly the Stanford Cars dataset. |
Copied to clipboard
| Challenge: | Existing approaches to attack text classification are limited due to the complexity of the problem. |
| Approach: | They propose a greedy algorithm to generate adversarial examples that maintain lexical correctness, grammatical correctiness and semantic similarity. |
| Outcome: | The proposed algorithm maintains lexical correctness, grammatical correctity and semantic similarity well and is hard for humans to perceive. |
Copied to clipboard
| Challenge: | Existing text augmentation methods generate instances with shifted feature spaces, which leads to a drop in performance on large datasets. |
| Approach: | They propose a hybrid instance-filtering framework that generates instances with shifted feature spaces, which leads to a drop in performance on augmented data. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on three classification tasks and nine public datasets. |
Copied to clipboard
| Challenge: | Experimental results show that incorporating utterances without majority-agreed labels into an additional class reduces the classification performance of the other emotion classes. |
| Approach: | They propose to combine utterances without majority-agreed labels into an additional class . they propose to quantify uncertainty in emotion classification using evidential deep learning . |
| Outcome: | The proposed method retains classification accuracy while effectively detects ambiguous emotion expressions. |
Copied to clipboard
| Challenge: | Traditionally, machine translation (MT) pursues a "human-oriented" objective: generating fluent output for a downstream task. |
| Approach: | They propose a neural machine translation approach that uses weak feedback to generate translations that are best suited for a downstream task. |
| Outcome: | The proposed approach outperforms general-purpose models and reinforcement learning methods on German and Italian tweets. |
Copied to clipboard
| Challenge: | polarity items are lexical items that can only appear in specific licensing contexts. |
| Approach: | They analyze sentiment analyzers for negative polarity items and a set of 150 test sentences . they describe a syntactic phenomenon that an ideal sentiment analyzeur must understand . |
| Outcome: | The proposed method focuses on two sentential structures: downward entailment and non-monotone quantifiers. |
Copied to clipboard
| Challenge: | a classifier that uses a nonparametric post-processing step for classification suffers when given examples that are close to its decision boundary. |
| Approach: | They propose a nonparametric post-processing step that re-adjusts predicted class probability distributions using high-confidence validation examples. |
| Outcome: | The proposed method improves classifier accuracy on difficult examples. |
Copied to clipboard
| Challenge: | Experimental results show that identifying the phases of opioid use disorder is highly contextual and challenging. |
| Approach: | They analyze 2500 opioid-related posts from various subreddits labeled with six different phases of opioid use . they annotate span-level extractive explanations and critically evaluate state-of-the-art models in a supervised, few-shot, or zero-shot setting. |
| Outcome: | The proposed models improve classification accuracy and quality of the extracted explanations. |
Copied to clipboard
| Challenge: | Mental health problems are a major risk factor for suicide attempts. |
| Approach: | They propose to integrate information from sentences to left and right of the target sentence into the model to improve classification accuracy. |
| Outcome: | The proposed model was able to classify suicidal behaviour in autism spectrum disorder patient records significantly better than previous approaches. |
Copied to clipboard
| Challenge: | Prior work has shown that ICL is sensitive to different natural language instructions and different orderings of in-context examples. |
| Approach: | They propose two principles for in-context example ordering guided by model’s probability predictions. |
| Outcome: | The proposed model outperforms baseline models on 13 text classification datasets and nine autoregressive LLMs with 700M to 13B parameters. |
Copied to clipboard
| Challenge: | Recent efforts to detect fake news use language-based approaches to detect news articles . authors show that readability features can improve classification accuracy . |
| Approach: | They propose to use readability features to detect fake news in the Brazilian Portuguese language . they show that such features can achieve up to 92% classification accuracy . |
| Outcome: | The proposed features achieve up to 92% accuracy and may improve previous classification results. |
Copied to clipboard
| Challenge: | Text classification is one of the most widely studied tasks in natural language processing. |
| Approach: | They propose to use large multilayer neural network models to compose meaning of sentences . they propose to disincentivize focusing on key lexicons to improve classification accuracy . |
| Outcome: | The proposed models learn to compose the meaning of the sentences or focus on key lexicons for classifying the document. |
Copied to clipboard
| Challenge: | Hierarchical text classification is a complex task that requires extended training time and a large number of parameters. |
| Approach: | They propose a top-up-classification task using dictionaries and auxiliary task from external dictionary definitions. |
| Outcome: | The proposed method outperforms previous studies using a reduced number of parameters in two well-known English datasets. |
Copied to clipboard
| Challenge: | Existing approaches to hierarchical text classification focus on parent-child relationships . however, some texts with a category hierarchy also have latent relevancy among labels in the same level of the hierarchy. |
| Approach: | They propose a method to analyze latent relevancy of peer labels and a sample importance learning method to ameliorate the side effects. |
| Outcome: | The proposed method improves the latent relevancy of peer labels on standard datasets. |
Copied to clipboard
| Challenge: | We present the MASSIVE dataset–Multilingual Amazon Slu resource package (SLURP) for Slot-filling, Intent classification, and Virtual assistant evaluation. |
| Approach: | They present a 1M-example dataset of Amazon Slu utterances . they localize the dataset into 50 typologically diverse languages . |
| Outcome: | The proposed model includes exact match accuracy, intent classification accuracy, and slot-filling F1 score. |
Copied to clipboard
| Challenge: | Framing is a political strategy in which journalists and politicians emphasize certain aspects of an issue to influence and sway public opinion. |
| Approach: | They propose a BERT-based model which embeds indicators of frames from news articles in order to predict political bias. |
| Outcome: | The proposed model performs on subframes and political bias classification tasks and is able to detect political bias on both zero-shot and few-shot learning tasks. |
Copied to clipboard
| Challenge: | Using metaphors in media discourse is an increasingly researched topic . media are an important shaper of social reality and metaphors indicate how we think about issues through references to other things. |
| Approach: | They propose a neural transfer learning method for detecting metaphorical sentences in Slovene . scheme can be used for future metaphor annotations of other socially relevant topics . |
| Outcome: | The proposed method can be used for future metaphor annotations of other socially relevant topics. |
Copied to clipboard
| Challenge: | Recent Neural Topic Models (NTMs) have limited applications in the real world due to the challenge of incorporating human knowledge. |
| Approach: | They propose a semi-supervised neural topic modeling method, vONTSS, which uses von Mises-Fisher variational autoencoders and optimal transport. |
| Outcome: | The proposed method outperforms existing semi-supervised topic modeling methods on multiple aspects. |
Copied to clipboard
| Challenge: | Existing approaches to identify emotions in short text are limited and lack coverage and inaccuracies when applied to informal short text. |
| Approach: | They propose a novel emotional network to jointly learn sentence emotions and construct emotion lexicons which are dynamically adapted to a given context. |
| Outcome: | The proposed model outperforms several approaches proposed in previous studies and achieves new state-of-the-art on the benchmark Twitter dataset. |
Copied to clipboard
| Challenge: | Existing methods for posterior calibration return uncalibrated estimations of class posteriors, thus leading to poorer generalization. |
| Approach: | They propose an end-to-end trained calibrator that directly optimizes the objective while minimizing the difference between predicted and empirical posterior probabilities. |
| Outcome: | The proposed calibrator reduces calibration error and improves performance on benchmark NLP classification tasks. |
Copied to clipboard
| Challenge: | Existing studies show translation artifacts in translations influence performance of cross-lingual tasks. |
| Approach: | They propose a method to reduce translation artifacts by extending an established bias-removal technique. |
| Outcome: | The proposed method reduces translationese at sentence and word level . it is the first study to debias translations on a natural language inference task . |
Copied to clipboard
| Challenge: | Recent research shows keyword-driven methods can achieve state-of-the-art performance on various tasks. |
| Approach: | They propose an efficient weakly-supervised text classification approach using unlabeled data . they use dense text representation to retrieve class-relevant documents from unlabed corpus . |
| Outcome: | The proposed weakly-supervised classification method outperforms keyword-driven models on a wide range of classification tasks. |
Copied to clipboard
| Challenge: | Existing methods for text classification based on large language models are difficult to apply directly to solve. |
| Approach: | They propose a data quality enhancement method to improve LLMs' performance in classification tasks by using a greedy algorithm to select data and then performing fine-tuning. |
| Outcome: | The proposed method improves the performance of large language models in text classification tasks and significantly improves training efficiency, saving nearly half of the training time. |
Copied to clipboard
| Challenge: | Latent Synthesis is an efficient textual data utilization framework for end-to-end speech processing models . labeled speech data are scarcer and more expensive for collection compared to textual ones . |
| Approach: | They propose a textual data utilization framework for E2E speech processing models . they train a latent synthesizer to convert textual information into an intermediate latent representation . |
| Outcome: | The proposed framework improves on low-resource speech recognition and spoken language understanding tasks. |
Copied to clipboard
| Challenge: | Existing toxic content detection methods focus on sentence-level classification but fail to provide readable and contiguous toxic evidence spans. |
| Approach: | They propose an explainability-oriented method for Chinese toxic content detection methods . they refine saliency cues into fine-grained toxic spans with lightweight LLM guidance . |
| Outcome: | The proposed method improves classification accuracy and toxic span extraction while preserving efficient encoder-based inference and producing more coherent explanations. |
Copied to clipboard
| Challenge: | The corpus contains reviews in English, Japanese, German, French, Spanish, and Chinese, which were collected between 2015 and 2019 . |
| Approach: | They propose to use mean absolute error (MAE) instead of classification accuracy for this task since MAE accounts for ordinal nature of the ratings. |
| Outcome: | The proposed model uses mean absolute error (MAE) instead of classification accuracy since MAE accounts for ordinal nature of the ratings. |
Copied to clipboard
| Challenge: | Modern NLP systems rely on word embeddings as input units to encode statistical semantic and syntactic properties of words. |
| Approach: | They propose to use discrete cosine transform to compress word sequences in order-preserving manner. |
| Outcome: | The proposed model preserves syntactic information in semantic probing tasks . it is comparable to vector averaging but mediocre in performance. |
Copied to clipboard
| Challenge: | Recent research has developed models targeting specific modalities but lacks transferability between formats. |
| Approach: | They conduct extensive experiments using few-shot in-context learning with large language models to explore the transferability of hate speech detection between modalities. |
| Outcome: | The proposed model outperforms vision-language demonstrations in few-shot learning settings. |
Copied to clipboard
| Challenge: | Existing text classification systems require thousands of in-domain text data to achieve high performance. |
| Approach: | They propose an algorithm to improve task transferability of meta-learning-based text classification by normalizing negative conditional entropy from source task data to boost cross-domain meta- learning accuracy. |
| Outcome: | The proposed method improves section classification accuracy significantly compared to meta-learning algorithms. |
Copied to clipboard
| Challenge: | a large number of test instances overlap considerably with pretraining corpora, a study finds . for a number of years, models struggled to exceed chance-level performance . |
| Approach: | They analyze the effects of varying degrees of overlaps that occur between pretraining corpora and test instances in WSC-style tasks. |
| Outcome: | The WSC-Web dataset is the largest to date and has lower overlaps with current pretraining corpora. |
Copied to clipboard
| Challenge: | SCOOS leverages semantic cues embedded in class labels to improve classification accuracy. |
| Approach: | They propose a method to create a compact feature space around class label semantics . they use a shared latent space between ID features and class names to minimize losses . |
| Outcome: | The proposed method outperforms existing methods for out-of-scope intent detection and ID intent classification. |
Copied to clipboard
| Challenge: | Identifying guardrails in conversational AI agents is critical for identifying malicious content . identifying guardrail components in black-box AI agents poses security challenges . |
| Approach: | They propose a method that leverages guard-specific adversarial prompts to detect guardrails in black-box AI agents. |
| Outcome: | The proposed method achieves perfect classification accuracy in multiple scenarios. |
Copied to clipboard
| Challenge: | Existing methods for identifying Arabic dialects require significant amounts of annotated training data which is costly and time consuming to produce. |
| Approach: | They propose a novel approach to Arabic dialect identification using language bivalency and written code-switching to identify Arabic dialects. |
| Outcome: | The proposed method can reach more than 76% and score well (66%) when tested on unseen data. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are mainly trained on English data and struggle with low-resource languages. |
| Approach: | They propose to add a new language to Llama to improve classification accuracy for Persian tasks by aligning representations through bilingual pretraining and instruction datasets. |
| Outcome: | The proposed model performs on generation and classification tasks with no adverse impact and sometimes even improvements on English tasks. |
Copied to clipboard
| Challenge: | Concept Bottleneck Models (CBMs) map visual representations to a set of humanunderstandable textual concepts, which are then interpreted by a linear combination of these concept scores. |
| Approach: | They propose a dynamic, agent-based approach that adjusts the concept bank in response to environmental feedback, optimizing the number of concepts for sufficiency yet concise coverage. |
| Outcome: | The proposed model improves classification accuracy by 6% and interpretability assessments by 30%. |
Copied to clipboard
| Challenge: | Existing methods define important nodes as important and target them for attacks if the model treats nodes’ predictive influence more uniformly . Existing approaches target high predictive influence nodes but are vulnerable to malicious message injection attacks. |
| Approach: | They propose a defense mechanism that encourages the model to learn graph representations where nodes with varying importance have a more uniform influence on predictions. |
| Outcome: | Extensive experiments on the Twitter and Weibo datasets show that similarizing the predictive Influence of nodes with Contrastive Learning significantly enhances resistance against LLM-driven message injection attacks. |
Copied to clipboard
| Challenge: | Existing research on text classification models ignores the semantic information inherent in labels, treating them as one-hot vectors. |
| Approach: | They propose a model-agnostic method that leverages label semantics and auto detection of hard samples to improve classification accuracy. |
| Outcome: | The proposed method shows significant improvements across different PLMs. |
Copied to clipboard
| Challenge: | Data augmentation aims to alleviate the overfitting issue in low-resource or class-imbalanced situations. |
| Approach: | They propose a framework called Text AutoAugment to enhance training samples . they use a Bayesian optimization algorithm to search for the best policy . |
| Outcome: | The proposed framework outperforms baseline methods on six benchmark datasets. |
Copied to clipboard
| Challenge: | Current news datasets focus on text features and rarely leverage the feature of images. |
| Approach: | They propose a news dataset that uses both images and text to achieve better news classification. |
| Outcome: | The proposed model improves on the existing dataset N24News with text and image information. |
Copied to clipboard
| Challenge: | Existing methods for classifying memes are difficult to perform, with human accuracy only about 85% . recent state-of-the-art models perform considerably less accurately, achieving up to 64.73% accuracy. |
| Approach: | They propose to use an off-the-shelf caption generator to capture the first image and overlayed text. |
| Outcome: | The proposed tool improves classification accuracy for unimodal and multimodal models . the proposed tool can be used to model the contrast between image content and overlayed text . |
Copied to clipboard
| Challenge: | Existing MCoT methods focus on inter-object reasoning, overlooking intra-object understanding crucial for image classification. |
| Approach: | They propose a Weak-supervision-guided Step-by-step Explanation method that reformulates MCoTs under weak supervision into concise, interpretable reasoning chains. |
| Outcome: | The proposed method improves interpretability by 37% and improves classification accuracy. |
Copied to clipboard
| Challenge: | Construction Grammar posits constructions as the central building blocks of language . human-like performance of pretrained language models on many NLP tasks has been alleged . |
| Approach: | They propose to use construction grammar to posit constructions as the central building blocks of language . they conduct experiments with three pretrained language models to examine their ability to classify and understand English comparative correlative . |
| Outcome: | The proposed models are able to recognise the English comparative correlative (CC) but fail to use its meaning. |
Copied to clipboard
| Challenge: | Existing approaches to detect harmful queries to large language models are fallible and vulnerable to attacks that exploit mismatched generalization of model capabilities. |
| Approach: | They propose an approach to detect harmful queries to large language models (LLMs) OMNIGUARD identifies internal representations of an LLM/MLLM that are aligned across languages or modalities and builds a language-agnostic or modality-adic classifier for detecting harmful prompts. |
| Outcome: | OMNIGUARD improves harmful prompt classification accuracy by 11.57% over the strongest baseline in a multilingual setting, by 20.44% for image-based prompts, and sets a new SOTA for audio-based ones. |
Copied to clipboard
| Challenge: | ML models with handcrafted features are linguistically explainable, expandable, and competent against the modern neural models. |
| Approach: | They propose to combine traditional ML models with ML transformers to improve readability assessment by 99% accuracy. |
| Outcome: | The proposed model achieves state-of-the-art (SOTA) accuracy on popular datasets. |
Copied to clipboard
| Challenge: | Existing topic seed words are difficult to incorporate into topic models due to the semantic diversity of natural language. |
| Approach: | They propose a neural topic model enhanced with supervisions from seed words on word and document levels. |
| Outcome: | The proposed model outperforms the state-of-the-art seeded topic models in terms of topic quality and classification accuracy. |
Copied to clipboard
| Challenge: | Existing methods to study complex emotions when a speaker collaborates with a partner are limited. |
| Approach: | They propose to fuse a multimodal dialogue resource with transcribed speech and eye gaze data to create a highly multimodal corpus. |
| Outcome: | The proposed model improves classification accuracy by 21% over baseline using sensor and speech data in 4.5 seconds. |
Copied to clipboard
| Challenge: | Existing instruction-tuned Large Language Models (LLMs) have impressive language understanding and the capacity to generate responses that follow specific prompts. |
| Approach: | They evaluate the zero-shot performance of two publicly accessible LLMs, ChatGPT and OpenAssistant, in the context of six Computational Social Science classification tasks. |
| Outcome: | The proposed LLMs perform better than state-of-the-art models on social science tasks. |
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have propelled significant progress, extending their application across various domains including dialogue systems, text generation, translation systems, and beyond. |
| Approach: | They propose to use the Word-in-Context (WiC) task to reassess the semantic knowledge encoded in large language models (LLMs) they prompt LLMs to generate natural language descriptions that contrast the meanings of the target word in two contextual sentences given in the WiC dataset. |
| Outcome: | The proposed model significantly improves the classification accuracy of the two models. |
Copied to clipboard
| Challenge: | Existing adaptation methods overlook structural knowledge between text and image modalities or create overly complex graphs containing redundant information for alignment. |
| Approach: | They propose a method to adapt visual models to downstream tasks using text and image modalities. |
| Outcome: | The proposed method improves classification accuracy by 1.51% for 1-shot and 0.74% for 16-shot on 11 datasets. |
Copied to clipboard
| Challenge: | Recent advances in self-supervised learning provide new opportunities to analyze Italy’s linguistic varieties using speech data alone. |
| Approach: | They propose to automatically identify the geographic region of origin of speech samples drawn from Italy's diverse language varieties. |
| Outcome: | The proposed model can identify regions from speech recording and improve classification accuracy and yields embeddings that distinctly separate regional varieties. |
Copied to clipboard
| Challenge: | Recent advances in language modeling have shown promising results when applied to time series data. |
| Approach: | They propose a method to fine-tune large language models for time series classification tasks using text embedding models and a simple classification head. |
| Outcome: | The proposed model outperforms the current SOTA model on a time series classification benchmark and uses only 14.5% of the trainable parameters. |
Copied to clipboard
| Challenge: | Existing explainable AI approaches focus on interpreting how models make predictions. |
| Approach: | They propose a pipeline that generates textual descriptions using large language models . they propose 'cross-modal transfer classification' task to examine effectiveness of textual description . |
| Outcome: | The proposed method improves classification accuracy compared to baselines and sheds light on how the model prioritizes and utilizes information for decision-making. |